Is the General Form of Renyi's Entropy a Contrast for Source Separation?

نویسندگان

  • Frédéric Vrins
  • Dinh-Tuan Pham
  • Michel Verleysen
چکیده

Renyi’s entropy-based criterion has been proposed as an objective function for independent component analysis because of its relationship with Shannon’s entropy and its computational advantages in specific cases. These criteria were suggested based on “convincing” experiments. However, there is no theoretical proof that globally maximizing those functions would lead to separate the sources; actually, this was implicitly conjectured. In this paper, the problem is tackled in a theoretical way; it is shown that globally maximizing the Renyi’s entropy-based criterion, in its general form, does not necessarily provide the expected independent signals. The contrast function property of the corresponding criteria simultaneously depend on the value of the Renyi parameter, and on the (unknown) source densities.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Blind source separation using Renyi's -marginal entropies

We have recently suggested the minimization of a nonparametric estimator of Renyi’s mutual information as a criterion for blind source separation. Using a two-stage topology, consisting of spatial whitening and a series of Givens rotations, the cost function reduces to the sum of marginal entropies, just like in the Shannon’s entropy case. Since we use a Parzen window density estimator and elim...

متن کامل

BLIND SEPARATION OF CONVOLUTIVE MIXTURES USING RENYI’S DIVERGENCE By KENNETH E. HILD II A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY

of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy BLIND SEPARATION OF CONVOLUTIVE MIXTURES USING RENYI’S DIVERGENCE By Kenneth E. Hild II December 2003 Chair: Jose C. Principe Major Department: Electrical and Computer Engineering A new information-theoretic (IT) criterion is introduced,...

متن کامل

On the Risk of Using RÉnyi's Entropy for Blind Source Separation

Recently, some researchers have suggested Rényi’s entropy in its general form as a blind source separation (BSS) objective function. This was motivated by two arguments: 1) Shannon’s entropy, which is known to be a suitable criterion for BSS, is a particular case of Rényi’s entropy, and 2) some practical advantages can be obtained by choosing another specific value for the Rényi exponent, yield...

متن کامل

Modeling the Overalternating Bias with an Asymmetric Entropy Measure

Psychological research has found that human perception of randomness is biased. In particular, people consistently show the overalternating bias: they rate binary sequences of symbols (such as Heads and Tails in coin flipping) with an excess of alternation as more random than prescribed by the normative criteria of Shannon's entropy. Within data mining for medical applications, Marcellin propos...

متن کامل

A General Framework for 1-D Histogram-baesd Image Contrast Enhancement

In this paper, a general framework for image contrast enhancement algorithm based on an optimization problem is presented. Through this optimization, the intensities can be better distributed. The algorithm is based on the facts that the histogram of the enhanced image is close to the input image histogram and uniform distribution, simultaneously. Based on this fact, we obtain a closed form opt...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007